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Abstract 


A  classical  algorithm  for  finding  a  minimum-cost  circulation  consists  of  repeatedly 
finding  a  residual  cycle  of  negative  cost  and  canceling  it  by  pushing  enough  flow  around 
the  cycle  to  saturate  an  arc.  We  show  that  a  judicious  choice  of  cycles  for  canceling 
leads  to  a  polynomial  bound  on  the  number  of  iterations  in  this  algorithm.  This  gives 
a  very  simple  strongly  polynomial  algorithm  that  uses  no  scaling.  A  variant  of  the 
algorithm  that  uses  dynamic  trees  runs  in  0(nm(logn)min{log(nC),mlogn})  time  on 
a  network  of  n  vertices,  m  arcs,  and  arc  costs  of  maximum  absolute  value  C.  This 
bound  is  comparable  to  those  of  the  fastest  previously  known  algorithms. 


1  Introduction 


The  minimum-cost  circulation  problem  is  that  of  finding  a  circulation  of  minimum  cost 
in  a  network  whose  arcs  have  flow  capacities  and  costs  per  unit  of  flow.  This  problem  is 
equivalent  to  the  minimum-cost  flow  problem  and  to  the  transshipment  problem,  and  it  has 
a  variety  of  applications  [7,18,20]. 


The  minimum-cost  circulation  problem  has  a  rich  history;  a  series  of  faster  and  faster 
algorithms  for  it  have  been  devised.  A  discussion  of  many  of  these  algorithms  can  be  found 
in  our  earlier  paper  [13];  we  summarize  some  of  the  previous  results  here. 

The  important  parameters  by  which  to  measure  the  running  time  of  an  algorithm  are 
n,  the  number  of  vertices  in  the  network;  m,  the  number  of  arcs;  U,  the  maximum  absolute 
value  of  an  arc  capacity;  and  C,  the  maximum  absolute  value  of  an  arc  cost.  For  ease  in 
starting  time  bounds,  we  assume  m  >  n  >  2.  In  bounds  containing  U  or  C,  the  capacities 
or  costs,  respectively,  are  assumed  to  be  integers. 


All  known  polynomial-time  algorithms  for  the  problem  use  the  idea  of  scaling  or  suc¬ 
cessive  approximation.  These  algorithms  compute  closer  and  closer  approximations  to  an 
optimal  solution.  The  idea  of  scaling  is  due  to  Edmonds  and  Karp  [6],  who  used  this 
idea  to  devise  the  first  polynomial-time  algorithm  for  the  problem.  Their  algorithm  uses 
capacity-scaling  and  has  a  running  time  of  0(m(logU)(m  +  nlogn))  if  the  fastest  known 
single-source,  nonnegative-cost  shortest  path  algorithm  [8]  is  used.  R5ck  [21]  exhibited  a, 
simpler  capacity-scaling  algorithm  achieving  the  same  time  bound  and  also  presented  a  cost¬ 
scaling  algorithm  with  a  running  time  of  0(n(logC)min{nmlog(n2/m),  n2log  U  +  nm}) 
if  the  fastest  known  maximum  flow  algorithm  [1,14]  is  used.  The  latter  bound  was  also 
obtained  later  by  Bland  and  Jensen  [3]  using  a  somewhat  different  cost-scaling  approach. 
A  generalization  of  the  cost-scaling  approach  has  been  proposed  in  [12,13,15]. 
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These  results  left  open  the  question  of  whether  there  is  a  strongly  polynomial  algorithm  ity  Codes 
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for  the  problem.  A  strongly  polynomial  algorithm  is  one  with  a  time  bound  polynomial 
in  n  and  m  if  arithmetic  operations  take  unit  time,  and  with  a  time  bound  polynomial  in 
n,  m,  log  U,  and  log  C  if  arithmetic  operations  take  time  polynomial  in  the  number  of  bits 
needed  to  represent  the  operands.  T&rdos  [24]  was  the  first  to  devise  a  strongly  polynomial 
algorithm  for  the  problem.  Other  strongly  polynomial  algorithms  were  later  proposed  by 
Orlin  [19]  and  Fujishige  [9].  The  fastest  known  strongly  polynomial  algorithm  is  that  of 
Galil  and  Tardos  [11],  which  runs  in  0(n2(logn)  (m  -f  nlogn))  time. 

For  networks  having  integer  arc  costs  that  are  not  huge,  the  asymptotically  fastest 
algorithm  is  the  one  previously  proposed  by  us  [13],  which  runs  in  0(r»m(log(n2/m)) 
min{log(n(7),mlogn})  time. 

All  the  known  polynomial-time  algorithms  for  the  problem,  whether  they  are  strongly 
polynomial  or  not,  are  somewhat  elaborate.  Our  purpose  in  this  paper  is  to  show  that 
a  simple,  classical  algorithm  for  the  problem  becomes  strongly  polynomial  if  a  careful 
choice  is  made  among  possible  iterative  steps.  The  algorithm  we  analyze  was  proposed 
by  Klein  [17].  We  call  it  the  cycle-canceling  algorithm.  This  algorithm  consists  of  repeat¬ 
edly  finding  a  residual  cycle  of  negative  cost  and  sending  as  much  flow  as  possible  around 
the  cycle.  Our  rule  for  choosing  cycles  is  to  always  select  a  cycle  whose  average  arc  cost 
is  smallest.  Such  a  cycle  is  called  a  minimum-mean  cycle.  A  minimum-mean  cycle  can 
be  found  in  0(nm)  time  using  an  algorithm  of  Karp  [16].  The  cycle-canceling  algorithm 
with  minimum-mean  cycle  selection  runs  in  0(nm  min{log(nC),  m  logn})  iterations  and 
0(n2m2min{log(nC),mlogn})  time.  This  algorithm  is  primal  (i.e.  maintains  a  feasible 
circulation),  very  simple,  and  does  no  scaling.  The  algorithm  itself  is  described  in  Section 
2  and  analyzed  in  Section  3. 

Although  this  algorithm  seems  to  be  of  mostly  theoretical  interest,  it  has  a  variant 
that  is  more  efficient.  The  variant  combines  more  flexible  cycle  selection  with  the  use  of  a 
sophisticated  data  structure  for  representing  dynamic  trees  [22,23,25].  It  has  an  asymptotic 
running  time  of  0(nm(logn)  min{log(nC),  mlogn}),  which  is  competitive  with  the  fastest 
previously  known  algorithms,  at  least  on  non-dense  networks  with  arc  costs  that  are  not 
huge.  This  algorithm  and  its  analysis  are  presented  in  Section  4.  Section  5  contains  some 
concluding  remarks. 
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2  Minimum- Cost  Circulations,  Cycle  Canceling, 

and  Minimum- Mean  Cycles 

Our  framework  for  discussing  the  minimum-cost  circulation  problem  is  the  same  as  in  our 
previous  paper  [13].  Let  G  —  (V,  E)  be  a  directed  graph  with  vertex  set  V  containing  n 
vertices  and  arc  set  E  containing  m  arcs.  We  require  G  to  be  symmetric ,  i.e.  (v,  w)  G  E  if 
and  only  if  (t»,»)  €  E.  For  a  vertex  v,  we  denote  by  E(v)  the  set  {tn|(t>,  w)  6  E).  Graph 
G  is  a  circulation  network  if  each  arc  (v,  w)  has  a  capacity  u(v,  w)  and  a  cost  c(v,  w),  both 
real  numbers.  We  require  the  cost  function  to  be  antisymmetric,  i.e.  c(v,  w)  =  —c(w,  v)  for 
all  (v,  to)  €  E. 

A  circulation  is  a  real-valued  function  /  on  arcs  satisfying  the  following  constraints: 

f(v,w)  <  u(v,w)  V(«,u>)  €  E  (capacity  constraints),  (1) 

f(v,  w)  =  —f(w,  v)  V(v,w)£E  (flow  antisymmetry  constraints),  (2) 

7!  f(v,w)  =  0  Vtn  G  V  (conservation  constraints).  (3) 

v€£(tv) 

The  cost  of  a  circulation  /  is  given  by  the  following  expression: 

cost(f)  =  i  c(v,w)f(v,w). 

(v,tu)6JE 

The  minimum-cost  circulation  problem  is  that  of  finding  a  circulation  of  minimum  cost. 

For  a  circulation  /  and  an  arc  (v,w),  the  residual  capacity  of  (v,  to)  is  u/(v,w)  = 
u(v,  w)  -  f(v,  w).  An  arc  (»,  w)  is  a  residual  arc  if  u/(v,  w)  >  0.  An  arc  that  is  not  residual 
is  saturated.  We  denote  by  Ej  the  set  of  residual  arcs.  A  residual  cycle  is  a  simple  cycle  of 
residual  arcs.  The  capacity  of  a  residual  cycle  is  the  minimum  of  the  residual  capacities  of 
its  arcs.  Note  that  the  capacity  of  any  residual  cycle  is  positive.  The  cost  of  a  cycle  is  the 
sum  of  the  costs  of  its  arcs.  A  residual  cycle  is  negative  if  it  has  negative  cost. 

The  following  classical  theorem  characterizes  minimum-cost  circulations: 

Theorem  2.1  [4].  A  circulation  is  minimum-cost  if  and  only  if  there  are  no  negative 
residual  cycles. 


Theorem  2.1  suggests  the  following  well-known  algorithm  due  to  Klein  [17]  for  computing 
a  minimum-cost  circulation,  which  we  call  the  cycle-canceling  algorithm.  Begin  with  any 
circulation  /.  (A  starting  circulation  can  be  compnted  using  any  maximum  flow  algorithm, 
such  as  the  algorithm  of  [14].)  Repeat  the  following  step  until  there  are  no  negative  residual 
cycles:  Find  a  negative  residual  cycle  T  and  cancel  it  by  increasing  the  flow  on  each  of  its 
arcs  by  an  amount  equal  to  the  capacity  of  T.  (This  saturates  at  least  one  arc  on  T.) 

The  cycle-canceling  algorithm  can  run  for  an  exponential  number  of  iterations  even  if 
the  capacities  and  costs  are  integers,  and  it  need  not  even  terminate  if  the  capacities  are 
irrational.  A  natural  question  is  whether  there  exists  a  rule  for  selecting  cycles  to  cancel 
that  results  in  a  number  of  iterations  bounded  by  a  polynomial  in  n  and  m.  We  answer 
this  question  in  the  affirmative. 

Our  selection  rule  is  simple:  always  cancel  a  residual  cycle  whose  average  arc  cost  is 
as  small  as  possible.  In  discussing  this  rule,  we  shall  use  the  following  terminology.  The 
mean  cost  of  a  cycle  is  its  cost  divided  by  the  number  of  arcs  it  contains.  A  minimum-mean 
cycle  is  a  cycle  whose  mean  cost  is  as  small  as  possible.  The  minimum  cycle  mean  of  a 
graph  with  arc  costs  is  the  mean  cost  of  a  minimum-mean  cycle.  We  call  our  selection  rule 
minimum-mean  selection. 

The  importance  of  minimum-mean  cycles  in  the  minimum-cost  circulation  problem  is 
suggested  by  a  result  in  our  previous  paper  [13].  There  we  obtained  a  strongly  polynomial 
algorithm  by  using  a  minimum  cycle  mean  computation  to  update  the  dual  variables. 

Minimum-mean  selection  can  be  regarded  as  a  generalization  of  the  rule  proposed  by 
Dinic  [5]  and  Edmonds  and  Karp  [6]  for  selecting  augmenting  paths  in  the  Ford- Fulkerson 
maximum  flow  algorithm  [7].  Their  rule  is  to  always  select  an  augmenting  path  containing  as 
few  arcs  as  possible.  A  standard  way  to  convert  a  maximum  flow  problem  into  a  minimum- 
cost  circulation  problem  is  to  give  every  original  arc  a  cost  of  zero  and  to  add  a  return 
arc  from  the  sink  to  the  source.  The  capacity  of  the  return  arc  is  infinite  and  the  cost 
is  minus  one.  The  minimum-mean  cycle- canceling  algorithm  on  this  augmented  network 
corresponds  exactly  to  the  Ford- Fulkerson  maximum  flow  algorithm  on  the  original  network; 
minimum-mean  selection  algorithm  corresponds  exactly  to  the  Edmonds-Karp  algorithm. 

A  minimum-mean  cycle  can  be  found  in  0(nm )  time  using  an  algorithm  of  Karp  [16]  or 
in  0(nm log  n)  time  using  a  new  algorithm  of  Young  [26].  Although  the  former  method  has 
a  smaller  worst-case  time  bound,  the  latter  method  might  be  preferable  in  practice,  since 
Karp’s  algorithm  has  a  best-case  running  time  of  fl(nm),  whereas  Young’s  method  ran  run 


much  faster.  In  the  next  section  we  show  that  the  cycle-canceling  algorithm  with  minimum- 
mean  selection  terminates  after  0(nm  min{log(nC),  m  log  n})  cycles  have  been  canceled, 
thereby  establishing  a  strongly  polynomial  bound  of  0(n2m2  min{log(nC),  m  log  n})  on  its 
running  time. 

3  Analysis  of  Minimum-Mean  Cycle- Canceling 

In  order  to  analyze  the  cycle-canceling  algorithm,  we  need  to  introduce  notions  from  linear 
programming  duality  theory.  A  price  function  p  is  a  real- valued  function  on  the  vertices  of  G. 
For  a  price  function  p,  the  reduced  cost  of  an  arc  (t>,  w)  is  cp(t>,  w)  =  c(w,  w)  +  p(v)  —  p(w). 
Observe  that  the  cost  of  a  residual  cycle  is  the  same  whether  the  original  arc  costs  or 
the  reduced  arc  costs  with  respect  to  some  price  function  are  used.  Furthermore,  the  flow 
conservation  constraints  (3)  imply  that  the  cost  of  any  circulation  is  unaffected  by  replacing 
original  costs  by  reduced  costs. 

The  following  classical  result  expresses  linear  programming  duality  for  the  special  case 
of  minimum-cost  circulations. 

Theorem  3.1  [7].  A  circulation  f  is  minimum-cost  if  and  only  if  there  is  a  price  function 
p  such  that,  for  all  (v,w)  €  E, 

Uf(v,  w)  >  0  =»  Cp( v,  id)  >  0  (optimality  constraint).  (4) 

The  optimality  constraints  are  more  commonly  called  the  complementary  slackness  con¬ 
straints. 

A  notion  of  approximate  optimality  plays  a  crucial  role  in  our  analysis.  The  appropriate 
notion,  called  e-optimality,  is  obtained  by  relaxing  the  complementary  slackness  constraints. 
The  relaxed  complementary  slackness  constraints  were  first  described  in  print  by  Tardos  [24] 
and  were  independently  discovered  by  Bertsekas  [2].  The  notion  of  e-optimality  is  the  basis 
of  several  minimum-cost  circulation  algorithms  [2,13,24].  For  an  e  >  0,  a  circulation  /  is 
e-optimal  if  there  is  a  price  function  p  such  that,  for  all  (v,  w)  G  E, 

uj(v,w)  >  0  =>  cp(v,w)  >  -e  (e-optimality  constraint).  (5) 

Note  that  0-optimality  is  equivalent  to  optimality.  Furthermore,  if  all  arc  costs  are 
integers  and  e  is  small  enough,  then  an  e-optimal  circulation  is  optimal. 
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Theorem  3.2  [2].  If  all  arc  costs  are  integers  and  e  <  1/n,  then  any  e -optimal  circulation 
is  minimum-cost. 

A  result  from  our  previous  paper  establishes  a  connection  between  e-optimality  and 
minimum  cycle  means.  For  a  circulation  /,  we  denote  by  ((f)  the  minimum  e  such  that  / 
is  e-optimal,  and  by  p(f)  the  mean  cost  of  a  minimum-mean  residual  cycle. 

Theorem  3.3  [13].  For  any  circulation  f,  e(f)  =  max{0,  -p(/)}. 

An  important  concept  concerning  minimum-cost  flows  is  that  of  the  admissible  graph 
G(f,p )  =  (V,E(f,p)).  The  admissible  graph  is  the  subgraph  of  the  residual  graph  induced 
by  the  arcs  with  negative  reduced  cost: 

E(f,p)  =  {(«,«>)  €  Ef\cp(v,w)  <  0}. 

The  following  lemma  provides  a  key  insight  into  the  problem.  Although  the  lemma  is 
not  used  until  Section  4,  it  motivates  the  analysis  of  the  current  section. 

Lemma  3.4  Suppose  a  circulation  f  is  (-optimal  with  respect  to  a  price  function  p  and 
G(f,p)  is  acyclic.  Then  f  is  (1  -  1  /n)(-optimal. 


Proof:  Let  T  be  a  simple  cycle  in  Gj,  and  let  /  be  the  length  of  I\  By  the  e-optimality  of 
/,  the  cost  of  every  arc  on  T  is  at  least  — e.  Since  the  admissible  graph  is  acyclic,  at  least 
one  arc  on  T  has  a  nonnegative  cost.  Therefore  the  mean  cost  of  T  is  at  least 


('-!)* 

I 


(n  -  l)f 
n 


=  -(1  -  l/n)e. 


Theorem  3.3  implies  that  /  is  (1  -  l/n)e-optimal.  | 

Now  we  have  enough  tools  to  analyze  the  minimum-mean  cycle- canceling  algorithm.  As 
a  measure  of  the  quality  of  the  current  circulation  /,  we  use  ((f):  the  smaller  ((f),  the 
closer  /  is  to  optimal.  Let  /  be  an  arbitrary  circulation,  let  c  =  e(/),  and  let  p  be  a  price 
function  with  respect  to  which  /  is  (-optimal.  Holding  (  and  p  fixed,  we  study  the  effect  on 
((f)  of  minimum-mean  cycle  cancellations  that  modify  /. 


Lemma  3.5  Canceling  a  minimum-mean  cycle  cannot  increase  ((f). 
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Proof :  Let  T  be  the  minimum-mean  cycle  that  is  canceled.  Before  T  is  canceled,  every 
residual  arc  satisfies  cp(v,w)  >  —e  by  e-optimality.  The  choices  of  e  and  T  imply  that 
every  arc  ( v ,  to)  on  T  satisfies  cp(t>,  to)  =  — e  before  canceling.  By  antisymmetry,  every  new 
residual  arc  created  by  canceling  T  has  cost  e.  (Every  such  arc  is  the  reversal  of  an  arc  on 
T.)  It  follows  that  after  cancellation  of  F,  every  residual  arc  still  satisfies  cp(v,  to)  >  — e. 
Thus  after  the  cancellation  e(f)  <  e.  | 

Lemma  3.6  A  sequence  of  m  minimum-mean  cycle  cancellations  reduces  ((f)  to  at  most 
(1  —  /n)e,  i.e.  to  at  most  1  —  1/n  times  its  original  value. 

Proof :  Consider  a  sequence  of  m  minimum-mean  cycle  cancellations.  As  /  changes,  the  ad¬ 
missible  graph  G(f,p)  changes  as  well.  Initially  every  arc  ( v,w)eE(f,p )  satisfies  cp(t>,  to)  > 
—(.  Canceling  a  cycle  all  of  whose  arcs  are  in  E(f,p)  and  adds  only  arcs  of  positive  reduced 
cost  to  E/  and  deletes  at  least  one  arc  from  E(f,p).  We  consider  two  cases. 

Case  1:  None  of  the  cycles  canceled  contains  an  arc  of  nonnegative  reduced  cost.  Then 
each  cancellation  reduces  the  size  of  E(f,p ),  and  after  m  cancellations  E(f,p)  is  empty, 
which  implies  that  /  is  optimal,  i.e.  e(f)  =  0.  Thus  the  lemma  is  true  in  this  case. 

Case  2:  Some  cycle  canceled  contains  an  arc  of  nonnegative  reduced  cost.  Let  T  be 
the  first  such  cycle  canceled.  By  the  proof  of  Lemma  3.4,  the  mean  cost  of  T  is  at  least 
—(1  —  l/n)e.  Thus  just  before  the  cancellation  of  T,  ((f)  <  (1  -  l/n)e  by  Theorem  3.3. 
Since  by  Lemma  3.5  e(f)  never  increases,  the  lemma  is  true  in  this  case  also.  | 

Lemmas  3.5  and  3.6  are  enough  to  derive  a  polynomial  bound  on  the  number  of  itera¬ 
tions,  assuming  that  all  arc  costs  are  integers. 

Theorem  3.7  If  all  arc  costs  are  integers,  then  minimum-mean  cycle-canceling  terminates 
after  0(nm  log( nC))  iterations. 

Proof:  Let  /  be  the  circulation  maintained  by  the  algorithm.  Initially  ((f)  <  C.  If  ((f)  < 
1/n,  then  «(/)  =  0  by  Theorem  3.1.  Lemmas  3.5  and  3.6  imply  that  if  *  is  the  total  number 
of  iterations,  (1  -  l/n)W*_,^m-l  >  l/(nC).  That  is,  [(i  -  l)/mj  <  -ln(nC)/ln(l  -  1/n)  < 
nln(nC),  since  ln(l  -  1/n)  <  -1/n  for  n  >  1.  It  follows  that  i  =  0(nmlog(nC)).  | 

To  obtain  a  strongly  polynomial  bound,  we  use  an  analysis  closely  following  that  of  [13). 
We  say  that  an  arc  is  (-fixed  if  and  only  if  the  How  through  this  arc  is  the  same  for  all 
(-optimal  circulations.  The  following  result  is  a  generalization  of  a  theorem  of  Tardos  [24]. 


Theorem  3.8  ([13])  Let  e  >  0,  suppose  a  circulation  f  is  e-optimal  with  respect  to  a  price 
function  p,  and  suppose  that  for  some  arc  (»,  t»),  |  cp(v,  w)  |>  2nc.  Then  (»,  w )  is  e- fixed. 

Consider  an  execution  of  the  cycle-canceling  algorithm.  Suppose  an  edge  ( v ,  w)  becomes 
fixed  at  some  point  of  the  execution.  Since,  by  Lemma  3.5,  the  error  parameter  e (/)  never 
increases,  the  flow  through  (v,  w)  henceforth  remains  the  same.  When  all  edges  axe  fixed, 
the  current  circulation  is  optimal.  To  see  this,  observe  that  an  optimal  circulation  is  e- 
optimal  for  any  e  >  0,  and  therefore  it  must  agree  with  the  current  circulation  on  all  (fixed) 
edges. 

The  following  theorem  bounds  the  number  of  iterations  of  the  cycle-canceling  algo¬ 
rithm  in  the  case  of  real-valued  costs.  In  the  proof,  we  use  the  following  inequality: 
(1  ~  £)n(lnn+1)  <  dL  for  n  >  2. 

Theorem  3.9  For  arbitrary  real-valued  arc  costs,  the  minimum-mean  cycle-canceling  al¬ 
gorithm  terminates  after  0(nm2  log  n)  iterations. 

Proof :  Let  k  =  m(n  fin  n  + 1] ).  Divide  the  iterations  into  groups  of  k  consecutive  iterations. 
We  claim  that  each  group  of  iterations  fixes  the  flow  on  a  distinct  arc  ( v ,  w),  i.e.  iterations 
after  those  in  the  group  do  not  change  f(v,w).  The  theorem  is  immediate  from  the  claim. 

To  prove  the  claim,  consider  any  group  of  iterations.  Let  /  be  the  flow  before  the  first 
iteration  of  the  group,  /'  the  flow  after  the  last  iteration  of  the  group,  e  =  e(/),  P  =  e(f'), 
and  let  p!  be  a  price  function  for  which  /'  satisfies  the  e'-optimality  constraints.  Let  T  be 
the  cycle  canceled  in  the  first  iteration  of  the  group.  The  choice  of  k  implies  by  Lemmas 
3.5  and  3.6  that  P  <  e(l  —  i)nPnn+1l  <  Since  the  mean  cost  of  T  is  — e,  some  arc  on  T, 
say  (v,u>),  must  have  cp(v,  u>)  <  -e  <  -2nP.  By  Lemma  3.5  and  Theorem  3.8,  the  flow  on 
(v,w),  will  not  be  changed  by  iterations  after  those  in  the  group.  But  f(v,w)  is  changed 
by  the  first  iteration  in  the  group,  which  cancels  T.  Thus  each  group  fixes  the  flow  on  a 
distinct  arc.  | 


Theorem  3.10  With  the  use  of  Karp’s  algorithm  for  finding  a  minimum-mean  cycle,  the 
minimum-mean  cycle- canceling  algorithm  runs  in  0(n2m3  logn)  time  on  networks  with  arbi¬ 
trary  real-valued  arc  costs,  and  in  0(n2m 2  min{log(nC).  m  logn})  on  networks  with  integer 
arc  costs. 

Proof:  Immediate  from  Theorems  3.7  and  3.9.  I 
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4  A  Faster  Variant  of  Minimum-Mean  Cycle- Canceling 


Although  Theorem  3.10  is  an  interesting  theoretical  result,  because  it  shows  that  a  classical 
minimum-cost  circulation  algorithm  is  strongly  polynomial  with  a  natural  choice  of  iterative 
steps,  the  bounds  on  the  performance  of  the  algorithm  are  not  competitive  with  those 
of  most  previous  polynomial-time  algorithms.  In  this  section  we  describe  a  variant  of 
the  minimum-mean  cycle-canceling  algorithm  for  which  the  time  per  iteration  is  O(logn) 
instead  of  0{nm).  This  improvement  is  based  on  a  more  flexible  selection  of  cycles  for 
canceling,  explicit  maintenance  of  a  price  function  to  help  identify  cycles  for  canceling,  and 
a  sophisticated  data  structure  to  help  keep  track  of  arc  flows. 

The  algorithm,  which  we  call  the  cancel-and-tighten  algorithm,  maintains  a  circulation 
/  and  a  price  function  p.  We  denote  by  e(/,p)  the  minimum  e  such  that  /  satisfies  the 
c-optimality  constraints  for  p,  i.e.  e(/,p)  =  max{0,  -  min{cp(v,  u>)|u/(t;,  w)  >  0}}.  We  call 
a  residual  arc  ( v ,  w)  admissible  if  cp( v,  w)  <  0,  and  a  residual  cycle  admissible  if  all  its  arcs 
are  admissible.  Initially  /  is  any  circulation  and  p  is  the  identically  zero  price  function. 
(Thus  e(/,p)  <  C  initially.)  The  algorithm  consists  of  repeating  the  following  two  steps 
until  the  circulation  /  is  optimal: 

Step  1  [cancel  cycles].  Repeatedly  find  and  cancel  admissible  cycles  until  the  admissible 
graph  is  acyclic. 

Step  2  [tighten  prices].  Modify  p  so  that  e(/,p)  decreases  to  at  most  (1  —  1/n)  times  its 
former  value. 

Theorem  4.1  The  cancel-and-tighten  algorithm  is  correct.  Each  iteration  of  Step  1  results 
in  the  canceling  of  at  most  m  cycles.  If  all  arc  costs  are  integers,  there  are  0(n  log(nC)) 
iterations  of  Steps  1  and  2. 

Proof:  The  first  two  statements  of  the  theorem  follow  by  the  proof  of  Lemma  3.6.  Namely, 
let  E(f,p)  be  the  set  of  admissible  arcs.  Canceling  an  admissible  cycle  reduces  the  size 
of  E{f,p)  by  at  least  one  and  cannot  increase  e(/,p),  since  all  newly  created  residual  arcs 
have  positive  cost.  Since  E(f,p)  has  maximum  size  m  and  minimum  size  0,  after  at  most 
m  cycle  cancellations  Step  1  terminates.  Lemma  3.4  implies  that  after  Step  1,  the  mean 
cost  of  a  residual  cycle  is  at  least  -(1  -  1/n)  e(/,p),  which  implies  that  p  can  be  modified 
to  satisfy  the  requirement  in  Step  2.  The  third  part  of  the  theorem  follows  as  in  the  proof 
of  Theorem  3.7.  | 


make-trte(v):  Make  vertex  v  into  a  one-vertex  dynamic  tree.  Vertex  t;  must  be  in  no 
other  tree. 

find~root(v):  Find  and  return  the  root  of  the  tree  containing  vertex  v. 

find-vahte(v):  Find  and  return  the  value  of  the  tree  arc  connecting  v  to  its  parent.  If  v 
is  a  tree  root,  return  infinity. 

find-min(v ):  Find  and  return  the  ancestor  w  of  v  such  that  the  tree  arc  connecting  w 
to  its  parent  has  minimum  value  along  the  path  from  v  to  find-rooi(v). 
In  case  of  a  tie,  choose  the  vertex  w  closest  to  the  tree  root.  If  v  is  a  tree 
root,  return  v. 

changt-value(v,  z):  Add  real  number  x  to  the  value  of  every  arc  along  the  path  from  v  to 
find-rooHy). 

link(v,  w):  Combine  the  trees  containing  v  and  w  by  making  w  the  parent  of  v  and 
giving  the  new  tree  arc  joining  v  and  to  the  value  x.  This  operation  does 
nothing  if  v  and  to  are  in  the  same  tree  or  if  to  is  not  a  tree  root.  A 
sequence  of 

cvt(v):  Break  the  tree  containing  v  into  two  trees  by  deleting  the  arc  from  v  to 
_ its  parent.  ThU  operation  does  nothing  if  ti  is  a  tree  root, _ 

Figure  1:  Dynamic  tree  operations. 

Now  we  show  how  to  implement  Steps  1  and  2.  Step  1  is  the  dominant  part  of  the 
computation.  A  simple  implementation  runs  in  0{nm)  time  (0(n)  per  cycle  canceled).  A 
more  complicated  implementation  runs  in  0(m  log  n)  time  (O(logn)  per  cycle  canceled). 

Performing  Step  1  is  essentially  the  same  as  converting  an  arbitrary  flow  into  an  acyclic 
flow  by  eliminating  cycles  of  flow,  and  algorithms  for  the  latter  purpose,  such  as  the 
0(m  log n)-time  algorithm  of  Sleator  and  Tarjan  [22],  can  be  adapted  to  the  former  pur¬ 
pose.  We  shall  describe  the  appropriately  modified  version  of  this  algorithm.  First,  however, 
we  describe  the  simple  implementation  of  Step  1  on  which  the  Sleator- Tarjan  algorithm  is 
based. 

The  simple  method  is  analogous  to  a  subroutine  in  Dinic’s  maximum  flow  algorithm  for 
finding  augmenting  paths  of  a  given  length,  once  a  layered  residual  network  is  constructed 
[5].  The  method  uses  depth-first  search  to  find  admissible  cycles.  Each  search  advances  only 
along  admissible  arcs.  Whenever  a  search  retreats  from  a  vertex  v,  this  vertex  is  marked 
as  being  on  no  admissible  cycles.  A  search  is  allowed  to  visit  only  unmarked  vertices. 
Whenever  a  search  advances  to  a  vertex  it  has  already  visited,  an  admissible  cycle  has  been 
found.  The  cycle  is  canceled  and  a  new  search  begun.  A  straightforward  implementation 
of  this  algorithm  has  a  running  time  of  0(m)  plus  O(n)  per  cycle  canceled,  for  a  total  of 
O(nm)  time. 


Step  la  [initialize].  For  each  vertex  v,  unmark  v  and  perform  make-tree  (t>). 

Step  lb  [find  starting  vertex  for  a  search].  If  all  vertices  are  marked,  stop.  Otherwise,  select  an 
unmarked  vertex  v  and  go  to  Step  lc. 

Step  lc  [find  end  of  path].  Perform  r  «—  find-root  (v).  If  there  is  no  admissible  arc  (r,  w)  with  w 
unmarked,  go  to  step  If.  Otherwise,  let  (v,  w)  be  such  an  arc  and  go  to  Step  Id. 

Step  Id  [extend  path].  If  find-root  (w)  ^  r,  perform  link{ry  w,uj(r,  u>))  and  go  to  Step  lc.  Otherwise, 
go  to  Step  le. 

Step  le  [cancel  cycle].  Let  6  =  min{u/(r,  w),  find-valne(find-min(w)}).  Perform  /(r,  w)  <— 
f(r,w)  +  6.  If  u/(v, ui)  =0,  mark  ( r,w )  inadmissible.  Perform  change-valve(w,—6).  While 
find-vahte(find  —  min(w))  =  0,  do  the  following:  u  «—  find-min(w)\  f(u,parent(u ))  «—  0; 
cut(u).  Go  to  Step  lb. 

Step  If  [retract  path],  Mark  r.  For  each  vertex  u  such  that  r  =  parent(u),  do  the  following:  /(u,  r)  «— 

_ ufvjw)  —  find-value(u)\  cut(u).  Go  to  Step  lb. _ 

Figure  2:  Implementation  of  Step  1. 


The  Sleator-Tarjan  algorithm  improves  on  this  method  by  using  a  dynamic  tree  data 
structure  [22,23,25]  to  avoid  explicitly  searching  along  the  same  path  many  times.  The 
data  structure  allows  the  maintenance  of  a  collection  of  vertex-disjoint  rooted  trees,  each 
arc  of  which  has  an  associated  real  value.  The  data  structure  supports  the  seven  operations 
described  in  Figure  1.  A  sequence  of  1  tree  operations  on  trees  of  maximum  size  k  takes 
0(1  log  k)  time. 

In  the  dynamic  tree  implementation  of  Step  1,  if  parent  ( v )  is  the  parent  of  a  vertex 
v,  then  ( v ,  parent  (v))  is  an  admissible  arc.  The  implementation  of  Step  1  is  described  in 
Figure  2. 

A  few  extra  data  structures  are  needed  in  this  method.  To  make  Step  lb  efficient,  the 
algorithm  maintains  a  list  of  all  vertices  and  a  current  pointer  into  this  list.  All  vertices 
preceding  the  pointer  are  marked.  To  find  an  unmarked  vertex,  the  algorithm  steps  the 
pointer  through  the  list,  stopping  at  the  first  unmarked  vertex.  Similarly,  to  find  admissible 
arcs  in  Step  lc,  the  algorithm  maintains  lists  of  the  arcs  leaving  each  vertex  and  a  current 
pointer  into  each  such  list.  In  addition,  for  each  vertex  v,  the  algorithm  maintains  parent(v) 
and  a  list  of  the  vertices  u  such  that  parent(u)  =  v.  A  straightforward  analysis  of  the 
algorithm  shows  that  it  requires  O(m)  tree  operations  and  runs  in  O(mlogn)  time. 

Step  2  of  the  cancel-and-tighten  algorithm  is  much  easier  to  implement.  The  simple 
method  described  in  Figure  3  has  an  0(m)  running  time. 

Since  Step  2  is  only  performed  when  there  are  no  admissible  cycles,  the  level  of  every 
vertex  is  well-defined,  and  Step  2a  can  be  performed  in  0(m)  time  by  computing  the  levels 


Step  2a  [compute  levels].  For  each  vertex  v,  compute  a  level  L(v),  defined  recursively  as  fol¬ 
lows:  If  ti  has  no  incoming  admissible  arcs,  L(v)  =  0.  Otherwise,  L(v)  =  ma x{I(u)  + 
l|(u,  v)  is  an  admissible  arc}. 

Step  2b  [compute  price  increment].  Compute  t  =  —  min{cp(f, w)  is  admissible}.  Compute  p  = 
min{(cp(v,  tc)  +  e)/(L(v)  -  L(w)  +  l)|u/(t>,  w)  >  0  and  L(v)  >  £(u>)}. 

Step  2c  [compute  new  prices].  For  all  veV,  replace  p(v)  by  p(v)  —  pL(v). _ 

Figure  3:  Implementation  of  Step  2. 

of  vertices  in  a  topological  order,  i.  e.  an  order  such  that  if  (v,  w)  is  an  admissible  arc,  L(v) 
is  computed  before  L(w).  Step  2b  obviously  takes  O(m)  time;  Step  2c,  O(n)  time.  The 
following  lemma  shows  that  this  implementation  of  Step  2  achieves  the  required  decrease 
in  </,p): 

Lemma  4.2  Steps  2a-2c  reduce  ((/,  p)  to  at  most  1  —  1/n  times  its  former  value. 

Proof:  In  Step  2b,  the  computed  value  of  c  is  c(/,p).  Every  admissible  arc  (r,  u>)  has 
L(v)  <  L(w )  by  the  definition  of  levels.  Thus  the  only  arcs  participating  in  the  definition 
of  p  are  those  of  nonnegative  reduced  cost.  It  follows  that  p  >  0. 

The  price  change  in  Step  2c  increases  the  cost  of  each  arc  (v,  w)  such  that  L(v)  <  L(w)  by 
an  amount  p(L(w)  —  £(»)).  This  includes  all  the  originally  admissible  arcs.  Thus  each  such 
arc  has  cost  at  least  —  e  +  p  after  Step  2c.  Reduced  cost  of  an  arc  (v,  w)  with  L(v)  —  L(w) 
is  not  changed  by  Step  2c,  and  thus  the  reduced  cost  remains  nonnegative.  Reduced  cost 
of  an  arc  with  L(v)  >  L(w )  is  decreased  by  p(L(v)  -  L(w)).  If  cp(v,w)  is  its  original 
reduced  cost,  its  new  reduced  cost  is  cp(v,  w)-  p  (L(v)  -  L(w))  >  -e  +  p  by  the  definition 
of  p.  Thus  after  Step  2c  c(/,p)  <  e  —  p.  The  definition  of  p  implies  that  p  >  e/n,  which 
implies  that,  after  Step  2c,  e(/,p)  <  (1  -  l/«)e,  as  desired.  | 


The  dynamic  tree  implementation  of  Step  1  and  the  above  implementation  of  Step  2 
yield  an  O(mlogn)  time  bound  per  iteration  of  Steps  1  and  2.  Theorem  4.1  gives  an 
0(nm  log  n  log( nC))  bound  on  the  total  time  to  find  a  minimum-cost  circulation.  This 
algorithm  is  not  strongly  polynomial,  but  the  implementation  of  Step  2  can  be  modified 
to  give  a  strongly  polynomial  method.  Namely,  every  nth  iteration  of  Step  2  is  performed 
differently.  At  such  an  iteration,  we  replace  c  by  c (/)  and  then  replace  the  price  function 
P  by  a  price  function  j/  such  that  /  is  c(/)-optimal  with  respect  to  p'.  In  our  previous 
paper  [13]  we  show  how  to  find  c(/)  and  pf  in  O(nm)  time  using  an  algorithm  of  Karp  [16] 


for  finding  a  minimum  mean  cost  cycle  and  the  Bellman-Ford  algorithm  (see  e.g.  [25])  for 
finding  shortest  paths  from  a  single  source.  Since  these  computations  only  occur  once  every 
n  iterations  of  Steps  1  and  2,  they  do  not  affect  the  0(m  log  n)  bound  per  iteration,  except 
that  the  bound  becomes  amortized  instead  of  worst-case.  With  this  change  of  Step  2,  a 
bound  of  0(nm  log  n)  on  the  number  of  iterations  of  Steps  1  and  2  follows  as  in  the  proof 
of  Theorem  3.9.  This  bound  is  valid  for  arbitrary  real-valued  costs.  Thus  we  obtain  the 
following  theorem: 

Theorem  4.3  The  cancel-and-tighten  algorithm,  with  the  dynamic  tree  implementation  of 
Step  1  and  a  minimum  cycle  mean  computation  after  every  n  iterations,  runs  in  0(nm2( log  n)2) 
time  on  networks  with  arbitrary  real-valued  arc  costs,  and  in  O(nm(logn)  min{log(nC), 
mlogn})  time  on  networks  with  integer  arc  costs. 

5  Remarks 

Open  problems  remain,  concerning  both  the  practical  and  the  theoretical  ramifications  of 
our  results.  On  the  practical  side,  we  believe  that  the  practical  performance  of  the  algorithm 
described  in  Section  4  is  worth  investigating.  There  are  some  obvious  modifications  that 
should  improve  the  practical  performance  of  the  method.  For  example,  Step  1  need  not  be 
performed  unless  there  is  an  admissible  cycle,  and  Steps  2a-2c  can  be  repeatedly  performed 
until  such  a  cycle  exists.  Perhaps  some  alternative  implementation  of  Step  2  might  be  better 
in  practice.  It  is  not  clear  how  much  time  should  be  spent  between  iterations  of  Step  1  in 
trying  to  reduce  c(/,p). 

On  the  theoretical  side,  an  open  question  is  whether  one  can  reduce  the  asymptotic  run¬ 
ning  time  of  Step  1,  and  hence  of  the  entire  algorithm.  Previous  results  [13,14]  suggest  the 
possibility  of  an  0(mlog(n2/m))  bound.  More  generally,  it  would  be  interesting  to  see  what 
other  well-known  algorithms  for  the  minimum-cost  circulation  problem  and  other  problems 
can  be  made  polynomial  or  strongly  polynomial  by  choosing  iterative  steps  carefully.  An¬ 
other  question  is  to  what  extent  the  bounds  in  Theorems  3.10  and  4.3  can  be  improved  in 
special  cases.  For  example,  if  all  capacities  are  zero  or  one,  the  simple  implementation  of 
Step  1  of  the  cancel-and-tighten  algorithm  runs  in  0(m)  time,  and  the  bounds  in  Theorem 
4.3  decrease  by  a  factor  of  logn.  Probably  even  better  bounds  are  obtainable.  See  e.g.  [10]. 
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